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The invention is described in the following statement: 



METHOD OF IMAGE TEXTURE ANALYSIS 



FIELD OF THE INVENTION 

The invention relates to a computer-implemented method of analysing 
image texture. In particular, it provides a method of applying selected 
mappings to an image to generate a surface that may be analysed to 
characterise the texture of the image. 

BACKGROUND TO THE INVENTION 

Image texture is a useful characteristic for object differentiation. 
However, image texture is a difficult characteristic to describe without using 
some kind of comparison to already familiar objects. Thus, human analysis 
of image texture is highly subjective. A computer based texture analysis 
method has the potential to provide a quantitative, and therefore more 
useful, measure of texture. 

Once a textured object is in digital form the problem of analysis 
becomes a mathematical problem rather than the verbal problem of 
description. The mathematical problem has proven to be no less intractable. 

The problem of image analysis has traditionally been approached as 
an analysis of visual images or pictures of macroscopic objects, such as 
crops or forests, or microscopic objects such as stained tissues or cells. 
However, the principles of texture analysis are applicable to any image be 
it visual, acoustic or otherwise. Image texture can be qualitatively evaluated 
as having one or more of the properties of fineness, coarseness, 
smoothness, granulation, randomness, lineation or being mottled, irregular 
or hummocky. These are relative terms, a useful analysis of the 
characteristics of an image must include an absolute measurement of image 
properties. 

In general terms, the approaches to texture analysis can be divided 
into three primary techniques, these are : statistical, structural and spectral. 



Statistical techniques include first order approaches such as autocorrelation 
functions and higher order approaches such as gray-tone spatial- 
dependence matrices (see Haralick, Shanmugan & Dinstein; "Textural 
features for image classification", IEEE Transactions on Systems, Man and 
Cybernetics SMC-3(6), 610-621; 1973). Structural techniques include the 
use of primitives and spatial relationships (see Haralick; "Statistical and 
structural approaches to texture", Proceedings of the IEEE 67(5), 786-804; 
1979). The main spectral technique is Fourier analysis. 

There are five steps in image processing. These steps are image 
acquisition, pre-processing, segmentation, representation and description, 
and recognition and interpretation. The invention falls into the step of 
representation and description. Persons skilled in the art will be aware of 
existing techniques for performing the remaining four steps of image 
processing. 

A general explanation of the prior art relevant to texture analysis can 
be found in Chapter 9 of "Vision in Man and Machine" by Levine, M; 
McGraw-Hill, Kew York (1985). Despite research in the area of texture 
analysis no single method has been developed that completely describes 
texture either verbally or mathematically. 

Abdel-Mottaleb makes mention of texture analysis in United States 
Patent No 5768333, as a technique for second stage discrimination of 
objects. While, Abdel-Mottaleb makes use of a large number of gray level 
thresholds, image texture is then characterised by computing many features 
of each connected component in the resulting threshold separately, no 2- 
dimensional surface is formed.. 

OBJECT OF THE INVENTION 

It is an object of the present invention to provide a method of image 
texture analysis to usefully describe observed image texture. 

Further objects will be evident from the following description. 



DISCLOSURE OF THE INVENTION 

In one form, although it need not be the only or indeed the broadest 
form, the invention resides in a method of analysing the texture of an image, 
including the steps of: 

mapping the image into a first set of binary representations of the 
image, wherein each representation in the set corresponds to a 
transformation by a first monotonically varying operator; 

mapping each binary representation of this first set of binary 
representations into a further set of binary image representations using a 
second monotonically varying operator, thereby forming a matrix of binary 
image representations; 

transforming the matrix by allocating a scalar value to each binary 
image representation; 

plotting the scalar values in a multidimensional space against 
parameters of the first monotonically varying operator and the second 
monotonically varying operator; and 

identifying defined texture characteristics from the resulting plot. 

By monotonic operator is meant an operator, the result of which varies 
in only one direction, either only increasing or only decreasing, with a 
change in operator parameter. 

In preference/the first monotonically varying operator is a threshold 
operator wherein the value of the applied threshold varies monotonically 
from a minimum value to a maximum value to produce the first set. 

In preference, the second monotonically varying operator is a spatial 
operator wherein the value of the applied space varies monotonically from 
a minimum value to a maximum value to produce the further set for each 
representation in the first set. Suitably, the second monotonically varying 
operator is a mathematical sieve that sets to zero all openings below a 
defined size and sets to one all openings above the defined size. 
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The step of identifying defined texture characteristics may include the 
further step of comparing the plot of scalar values to a knowledge base of 
scalar value plots known to indicate defined texture characteristics. 

The method may further include the further step of calculating the 
5 derivative of the scalar plot and identifying one or more features of the 

derivative scalar plot as characterising image texture. 

In a further form, the invention resides in an image analysis apparatus 
comprising: 

storage means for storing a digital representation of an image; 

10 processing means for : 

mapping the image into a first set of binary representations of 
the image, wherein each representation in the set corresponds 
to a transformation by a first monotonically varying operator; 
mapping each binary representation of the first set of binary 

15 representations into a further set of binary image 

representations using a second monotonically varying 
operator, thereby forming a matrix of binary image 
representations; 

transforming the matrix by allocating a scalar value to each 
20 binary image representation; 

plotting the scalar values in a multidimensional space against 
parameters of the first monotonically varying operator and the 
second monotonically varying operator; and 
identifying defined texture characteristics from the resulting 
25 plot; and 

display means for displaying the plot of scalar values and identified 
texture characteristics. 
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BRIEF DETAILS OF THE DRAWINGS 

To assist in understanding the invention preferred embodiments will 
now be described with reference to the following figures in which : 
FIG 1 is a flow chart showing the method of the invention; 

5 FIG 2 process shows the values of the granold surface; 

FIG 3 displays a granold surface; 

FIG 4 is an example of the application of the method to an image; 

FIG 5a shows the granold surface derived from the example of FIG 4; 
FIG 5b shows the granold korner surface derived from the granold 
10 surface of FIG 5a; 

FIG 6 shows a first example of the application of the method to an 

image of ammonium sulphate pellets; 
FIG 7 shows a second example of the application of the method to an 

image of ammonium sulphate pellets; 
15 FIG 8 shows a third example of the application of the method to an 

image of ammonium sulphate pellets; and 
FIG 9 is a block diagram of an apparatus for working the invnetion. 

DETAILED DESCRIPTION OF THE DRAWINGS 

20 In the drawings, like reference numerals refer to like parts. Referring 

to FIG 1, the flow diagram indicates the steps of a method of texture 
analysis. The method is preferably implemented in a computer, persons 
skilled in programming will be able to readily produce appropriate code in a 
suitable language to implement the method. 

25 The flow diagram is directed to the situation in which the monotonic 

mappings are gray level thresholding and spatial opening. The example is 
two-dimensional but the method is applicable to multi-dimensional 
applications. A mathematical description is presented later which generalises 
the specific example to a wider range of situations. 

30 In the flow diagram, the gray level image to be analysed is designated 



as X. A threshold operator O t , is applied at a first value of i. Typically, an 8- 
bit gray level image might first be thresholded at gray level 0. A binary image 
<J>,(X) is obtained by this thresholding operation where pixels having a gray 
level above the threshold will have a value of one and all other pixels have 
a value of zero. Applying spatial operator Tj then opens the binary image. 

In the example described here, a set of disc shaped structuring 
elements of increasing radius is used. Thus, the smallest value of j 
corresponds to the first member in the set, which has the smallest radius. All 
pixel clusters having a radius less than j are set to zero and the rest are 
retained. The remaining area of the resulting binary image T^X) is then 
calculated (for example, by counting all pixels having a value of one) to give 
a value S^O^X). This value is stored in a two-dimensional array G x in a 
position corresponding to the i th threshold operator versus the j* h spatial 
operator. 

The value of j is iterated and the next spatial operator ^ is applied 
to Oj(X) and the value S^O^X) is calculated in stored in the array at 
location G x (i,j+1). The iteration and application of the spatial operator 
continues until j^j max . The value of j max may be arbitrarily chosen or may be 
the value of j such that STj^O^X) = 0. This process of continually opening 
a binary image with a suitable set of structuring elements and measuring the 
remaining area produces a morphological granulometry of the binary image. 

One the granulometry of the first binary image has been completed 
the original gray level image is thresholded for the next value of i. The 
morphological granulometry for the i+l* binary image is then formed and 
entered into the granold surface array. The process is repeated, as shown 
in FIG 1 , until i*i max . The value for i may be chosen arbitrarily or may be the 
value of the highest gray level threshold possible in the image. For an 8-bit 
gray level image this would be 255. 

The resultant array is represented in FIG 2 and is referred to as the 
topographical granold surface. The array has i max x j max elements that can be 
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plotted as a surface in the manner shown in FIG 3. Corners appear on the 
surface that indicate a relationship between size and gray level of granules 
in the original image. An idealised corner K^yj is shown in the surface 
G x (iJ) of FIG 3 at a position corresponding to i=i c and j=j c . Further 
processing, for example by differentiation of the granold surface, can be 
performed to highlight the corners. As shown in the following figures, further 
processing can result in a spectral-like result that simultaneously reveals the 
distribution of size and gray level of granules within the original image. 

FIG 4 shows an example of a number of images produced by the 
method described above. FIG 4a shows a 50x50 pixel gray level image. FIG 
4b is a binary image produced by thresholding the image of FIG 4a at a 
threshold level of 172. The image of FIG 4b is opened with a disc shaped 
structuring element of radius 1 to produce the image of FIG 4c. The image 
of FIG 4c is opened with a disc shaped structuring element of radius 2 to 
produce the image of FIG 4d. This process is continued with increasing 
radius until the remaining image is reduced to zero. The original image is 
thresholded at a gray level of 209 to produce the binary image of FIG 4e. 
Disc shaped structuring elements of radius 1 and 2 are used to produce the 
images of FIG 4f and FIG 4g respectively. 

FIG 4 clearly demonstrates that the number of remaining pixels 
decreases with increasing threshold and increasing radius of the spatial 
operator. The actual values of the granold surface calculated for each image 
are G x (172,1)=1296, G x (172,2)=1210, G x (209,1)=133 and G x (209,2)=0. 

The complete granold surface G x (i,j) for the image of FIG 4a is 
displayed in FIG 5a. The surface was constructed using a threshold operator 
that applied gray level thresholds from 0 to 255 and a spatial operator that 
applied a set of disc shaped structuring elements with radii from 1 to 1 6. The 
plot has been normalised to the original image area of 2500 pixels. The 
corresponding granold korner surface K^i j) is shown in FIG 5b. The granold 
korner surface provides a spectral-like plot that characterises the original 



image in a reproducible and objective manner. 
EXAMPLE 

Characterisation of matter by pellet size and colour intensity may be 
applicable to a variety of industries, such as confectionery, pharmaceuticals 
and fertilisers, for quality control. FIG's 6-8 provide an example of the 
application of the invention to the characterisation of ammonium sulphate 
pellets. 

In each of FIG's 6-8, image (a) is a gray level image produced by a 
video camera and frame grabber as ammonium sulphate pellets fall from a 
drum granulator in a fertiliser plant. The pellets of FIG 6 and FIG 7 are the 
same size but the pellets of FIG 8 are larger. Green food dye was added to 
the pellets to provide colour variation with FIG 6 being the darkest and FIG 
8 being the lightest. 

Image (b) of each figure is a plot of the granold surface produced by 
applying a threshold operator that applied gray level thresholds from 0 to 
255 and a spatial operator that applied a set of 16 disc shaped structuring 
elements. Image (c) is the corresponding granold korner surface. 

Further processing of the granold korner surface involved identifying 
the threshold/radius location of the maximum value of the surface. The value 
indicates the gray level and size of the majority of the pellets in the image. 
It will be appreciated that statistical analysis of the granold korner surface 
can characterise the pellets by the mean and standard deviation of the size 
and colour of the pellets. Such an analysis provides a useful standard for 
quality control. 

It will be appreciated that the foregoing examples are limited to two- 
dimensional space but can be generalised to a multi-dimensional space to 
produce a multi-dimensional granold surface. Furthermore, the operators 
that produce the mappings are not limited to size and intensity. Other 
suitable operators may include wavelength, position, pattern, etc. The 
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following generalised description is presented mathematically in a manner 
that will be understood by those skilled in the relevant art. 

MATHEMATICAL DESCRIPTION 

In order to describe the method it is necessary to define certain 
notations. In the following, "R +M denotes the non-negative real numbers 
(including zero), "Z" the integers {...,-1,0,1,...} and "N tt the natural numbers 
{0,1,2,...}. 

We define 

{F};Z n Z w (1) 

Here {F} represents the general class of m-integer valued functions on n- 
dimensional space. We would typically use such a function to represent a 
gray scale 2-D image, in which case we would write, for example, "let 
X e F be a 2-D gray scale image ... n . This statement implies that A7=2 and 
tt7=1 . We keep the dimensions of the image representation general (at n and 
m) so as not to unnecessarily limit the scope of the method to 2-D images. 
The domain of the image X e F will be denoted by Dom(X) . The domain 

is the set of al points in Z" for which X is defined. 
Next we define, 

B e (2) 
Where P is the powerset operator, so P(Z n ) is the set of all subets of Z" . 

B represents the general class of binary images on /7-dimensional integer 
space. We would typically use such a notation to represent a 2-D binary 
image where we would write, "let be a 2-D binary image ..." which statement 
implies that /?+2. Again, we keep the dimensions of the image general at n 
so as not to unnecessarily limit the scope of the method to 2-D images. The 
domain of the binary image B e B will be denoted Dom(B) . 



11 

Based on the image spaces defined above we now define the 
mappings or operators used to form the granold surface. Firstly, we define, 



This function to set mapping takes a gray scale image and returns a binary 
image. As an example let X e F be a 2-D gray scale image, so we could 
write, B= Q> (X) . The resulting image B e B is a 2-D binary image. 

The thresholding of regions based on region minima or maxima 
values, the thresholding of regions based on contrast dynamic values, and 
the gray level threshold operation, well known in image processing, are all 
examples of this type of mapping. 

Secondly we define, 



This set to set mapping, which we will call an "operator", takes a binary 
image and returns a binary image. As an example, let B <= B be a 2-D binary 
image so we could write, A= x ¥ (B) . The resulting image A e B is also a 
2-D binary image. 

The binary AND operation, the attribute opening operation, and the 
morphological binary opening operation, also well known in image 
processing, are all examples of this type of mapping. 

It is the intention that these mappings preserve the domain or support 
of the images in all cases, that is, 



<b:F-+ B 



(3) 



W:B B 



(4) 



£>om(<D {X)) = Dom(X) 



(5) 



and 



DomQ¥(B))= Dom{B) 
and with the composition of these mappings 
DomQ¥0(X))= Dom(X) 



(6) 



(7) 



Lastly, we define the set measure, 
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<?:B->R + (8) 

This set to scalar mapping, which we will call a "measure", takes a binary 
image and returns a non-negative scalar value. The area (number of object 
pixels) of a binary image is an example of this type of mapping, so we could 
write, for example, area = 8(B) . 

The next step is to parameterise the mappings O and W to give 
families of mappings and operators indexed on non-negative integer 
parameters i e N . Therefore we have families, 

{<D,.}:F-> B (9) 

and, 

0FJ:B->B (10) 

It is important for the method that the above mappings posses 
additional mathematical properties as follows: 

Property 1 - Monotone Decreasing for Parameter. 

The families of mappings <D, and X F, must be "monotone decreasing" 
with respect to their parameter i. Also, to ensure that (in the limit) the 
mappings extract all the information from the images, there should exist 
values M and N (which may depend on the images) such that for i>M and 
i>N respectively, the appropriate mappings produce the empty-set, 0 . In 
contrast, we should also ensure that the index zero mappings have the least 
possible effect on the image and respectively produce the domain of the 
image or reproduces the image itself. 

In mathematical terms, for the mappings $ t and for any X e F , 

/ = 0 => <D . ( = Dom(X) (1 1) 

0<i<j<M =>$ ; (I)c(I),(I) (12) 
/ > M => O f (AT)= 0 (13) 
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Likewise, for the operators x ¥ i and for any A e B , 

/=0 ^W t (A)=A (14) 
0<i<j<N Vj(A)q T,.(^) (15) 
/> AT => ¥,.(^0=0 (16) 



Property 2 - Monotone Increasing for Argument 

The families of operators (set to set mappings) V F I need to have some 
5 additional properties to ensure the granold surface is well behaved. Firstly, 

W t needs to be "anti-extensive" and to remove detail from the binary image 
BeB, that is, for all / e N 

V,(B)=B (17) 
Secondly, the operators H^must be "monotone increasing" with 

1 0 respect to their arguments, the binary images, that is for the binary images 

A, B e B for a fixed integer i e N 

Acz B^^^c^B) (18) 
Property 3 - Measurement 

Finally, the measure S , to represent the usual sense of measuring 
15 something, must be : (i) zero if the object to be measured is empty, 

<?(0)=O (19) 
and (ii) increasing, that is, 

Ac B=> 5{A)<S(B) (20) 
Now we consider the composition of these mappings as follows' 
(^,a> f ):F-> R + (21) 

This function to scaler mapping, which we have previously termed a 
"granold" (granulometry of threshold), takes a gray scale image and returns 
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a non-negative scalar which depends on the values of the parameters / and 
j (and of course the image itself). 

To show the dependence on / and j explicitly, we choose to denote 
the granold G x (i,J):N 2 -» R + of an image X e F as a 2-D function, 

def 

GxQ.fi^iWfliXX) (22) 

If G is represented as a function on two dimensions or a surface then 
regions / and j both have a large effect on the value of 5 will appear as 
"corners" in the surface. The location and "sharpness" of these corners will 
reveal the particular values of / and j that have a large effect on the value of 
5. 

The following first differences is useful for analysing G. These 
differences approximate the directional derivatives of the granold and will be 
large wherever there is a rapid fall in the granold in the corresponding 
directions. 

def 

k X x<Jj) = G x (i,j)-G x (i+ 1,7) (23) 

def 

**xQJ) = D x {iJ)- G x (iJ+ 1) (24) 
The quantity, 

def 

K X QJ) = min(A^(/ 5 yXA^(/ 5 7)) (25) 

is useful to determine where the granold surface has simultaneous large first 
differences in both the 0 . and the W t directions. 

A suitable apparatus for putting the invention into effect is shown in 
Fig 8. An image is acquired with acquisition means 1 . This could be a digital 
camera or digitizer that converts an analogue signal. Pre-processing may 
occur at 2. This may be on-board processing in the acquisition means 1 , or 
may be, for example, post-acquisition filtering. 
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Signals are passed to a processor 3 that is programmed to work the 
method described above. Required parameters may be stored in ROM 4 and 
temporary storage is provided by RAM 5. The resultant processed image is 
displayed on monitor 6. Other data storage means such as disk or tape (not 
shown) may also be connected to the processor 3. 

Persons skilled in the relevant art will appreciate that the method of 
image texture analysis can be applied to a diverse range of situations. The 
inventors have demonstrated the application of the method to fertiliser 
pellets. Preliminary considerations indicate that it is also applicable to 
analysis of cells on a microscopic level and skin screening at a macroscopic 
level. Throughout the specification the aim has been to describe the 
preferred embodiments of the invention without limiting the invention to any 
one embodiment or specific collection of features. 

DATED this second day of March1999 
THE UNIVERSITY OF QUEENSLAND 

By Their Patent Attorneys 

FISHER ADAMS KELLY 
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